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Abstract 

We analyze Jim Propp's P-machine, a simple deterministic process that 
simulates a random walk on Z*^ to within a constant. The proof of the error 
bound relies on several estimates in the theory of simple random walks and some 
careful summing. We mention three intriguing conjectures concerning sign- 
changes and unimodality of functions in the linear span of {p(-,x) : x G Z'^}, 
where p{n, x) is the probability that a walk beginning from the origin arrives 
at X at time n. 

Consider the following machine, which we call the P-machine after its progenitor, 
Jim Propp. We begin with a set of chips on "even" vertices of Z*^, i.e., those an even 
L^-distance from the origin. We label by = {0, 1, . . . ,2d — 1} the 2d directions 
of Z'^. (For example: North, South, East and West for d = 2.) On each vertex v 
there will be a "rotor" which will have a state j G ^2^. The initial states of the rotors 
can be set arbitrarily. The rotors work as follows: when one feeds it a chip, a rotor 
changes to state j + 1 (addition in Z2rf) and sends the chip to the vertex in direction j. 
Each time unit we feed all of the chips currently on each vertex to the rotor on that 
vertex. The result is a new distribution of chips. We imagine doing this operation 
for total time n. 

Now, consider the following process. We again begin with a set of chips on "even" 
vertices of Z'^. Each chip takes an ra-step simple random walk from its starting point. 
At time n, we expect that the P-machine and the random process should give rise 
to similar distributions if they begin with the same configuration of chips. For the 
random walk process we may consider the expected number of chips that will be at v 
at time n. Our main result is that the difference between this expected number and 
the actual number at v at time n in the deterministic P-machine is bounded uniformly 
- irrespective of how much time has passed, what the original chip distribution was, 
the starting states of the rotors, or even the choice of\! 
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As an example, suppose n is even, (i = 1, we begin with n chips at position 
0, and the total time is n. The random walk model will have an expected number 
^(n/2)^~'^ = Q{y/n) chips at position v = 0. The deterministic P-machine will give 
that number with only constant error. 

As a further interpretation, consider a "linear machine" in which a pile of c chips 
are split evenly, with ^ going in each direction. The final number (which, in general, 
will not be an integer) of chips at a position will simply be the expected number of 
chips in the random walk machine. We may consider the linear machine a "relaxation" 
of the P-machine, and our result states that this relaxation produces only constant 
"error." 

1 The Proof 

We introduce some notation. Chip distributions will be written as functions x from 
Z'^ to the nonnegative integers. We let n represent the total time of the process and 
let if: represent the time remaining in the process so that t counts backwards from n to 
0. Let Xt denote the configuration of the P-machine with time remaining t. Thus Xn 
is the initial configuration and Xo is the final configuration. We prescribe an ordering 
eo, . . . , e.2d^i on those vectors (directions) with all coordinates zero except for one 
which is or —1. We fix a map o" : Z'^ — > 'L2d denoting the initial settings of the 
rotors. Define St-, a map from 7/" to M, by setting S't(v) to be the probability that a 
random walk of time t beginning at the origin ends at v. For any distribution x and 
any t we define 

Wt{v,x)= X(w)^t(v-w), (1) 

This Wt acts as a weighted sum of all the chips when t is the time remaining. Thus 
W^o(v,Xo) is the actual number of chips at v at the conclusion of the P-machine 
process whereas VFn(v, Xn) is the expected number of chips at v at the conclusion of 
the random walk process. 

We (following P) write v ^ n if the sum of the coordinates of v has the same 
parity as n, and w w if v and w have the same parity in this sense. Call a 
configuration x "even" ("odd") if, for all v in the support of x, v <-> (resp., v ^ 1). 

Our main result is the following. 

Theorem 1. There is a constant Cd, depending on the dimension d hut not the initial 
even (or odd) configuration Xn, the total time n, nor the initial rotor settings a so 
that 

|W^0(v,X0)-W^n(v,Xn)| <C,. 

Proof. Clearly, we may assume without loss of generality that the configuration is 
even. Then, for n > t > we define 

Xt = Wt{Y,xt) (2) 

We may interpret Xt as the expected number of chips at v at the conclusion of 
a process in which the first n — t steps are by the deterministic P-machine and the 
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remaining t steps are in the random walk model. The sequence Xf, n > t > 0, is then 
reminiscent of a martingale. We first expand "in time" : 

n n 

X^-X, = Y,Xt- = Wt{-. Xt) - Wt^^{-, xt-i) (3) 
t=i t=i 

The summand in (jH)) is the change in weight during one step of the P-machine. 
To analyze this change we set 

T^^(w,t) = ^t(w)-St_i(w-e,) (4) 

This represents the change in weight of a single chip that was at position v + w with 
time remaining t and with the rotor at that position set to state j. Observe, critically, 
5't(w) is the average of all possible St-iiyf — ej) so that 

2d-l 

^T^(w,n) = (5) 

j=0 

Let Aw denote the total contribution to X„ — Xq from all chips moved from position 
V + w. (Effectively we are here moving the origin to v.) Suppose that during the 
process a chip was moved from v + w a total of M times and that the i-th time 
occured (starting the count at zero) when the remaining time was tj. Let c denote 
the initial state of position v + w. Then 

M-l 

Aw= 5^T^+^(w,t,) (6) 

(As before, we consider state c + i as an element of Z2d.) Reversing the sum of (jH)) 
we express 

Xn-Xo=J2 ^w. (7) 

1.1 Dimension One 

The case of = 1 is somewhat special, in that it requires separate arguments and 
is also susceptible to a more precise analysis. Nonetheless, it closely resembles the 
higher dimensional cases, and so we produce the proof in the one- dimensional case 
first. 

All vector quantities are simply integers when d = 1, and we may write 

T^{w,t) = St{w)-St-i{w±l) 

where the choice of sign is (—I)-'. Since, by (jSJ, T^{w,t) = —T^{w,t), can be 
written as an alternating sum of T^{w,ti) for some nonincreasing sequence tj. 

Now, we wish to show that the sequence {T^ {w,t)}t>i is unimodal. The uni- 
modality of the sequence T^{w, t) is important because it implies that T^{w, t) is the 
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concatenation of two monotone subsequences. An alternating sum of any monotone 
sequence which has all the same sign is bounded by its largest term. Therefore, we 
may estimate by twice the maximum of T^{w,t). 

It clearly suffices to consider the cases of w > 1 and w = - otherwise write 
in terms of T° instead of T^. Then, for t ^ w with w > 1, 

^ ^ \{t + w)/2) \{t + w)/2-l) 



2" 



-t+i 



t - 1 \ ( -w 



{t + w)/2 -Ij \t + w 



which is always negative. To determine when T^[w,t) is increasing or decreasing, we 
consider the ratio of consecutive terms in the range t > w: 

T\w,t + 2) t + w 4t(t + l) 



T^{w,t) 4:{t + w + 2) {t + w){t-w + 2) 
t{t + l) 



2 ■ 



{t + 2y-w 

When t{t + 1) < (t + 2)2 - i.e., when t > {w^ - 4)/3, the quantity T^iw,t) is 
increasing; when t < (w^— 4)/3 it is decreasing. (For t < w, the sequence is identically 
0.) Hence, T^{w,t) is unimodal for those t with t ^ w. 

To compute the maximum of T^{w,t), we plug in t = w'^/3 + 0(1), getting 
\T^{w, t) \ = Oiw""^). So, any alternating sum of T^{w, ti) for ti nonincreasing satisfies 
this same bound. (It is easy to see that, in the case of w = 0, T^{w, t) = 2^*^^ (^2) 
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also unimodal and bounded by a constant.) Therefore, ^^g^^l"^ ^) converges, and 
Theorem ^ follows in the case of c? = 1 , by (|7j) . 



1.2 Higher Dimensions 

In dimensions d > 2, the situation is more complicated. For d > 3 such elegant 
formulas as (jH)) simply do not exist, and we must use estimates for the terms in 
question. We suppress an argument for d = 2 using exact formulae as our methods 
below apply to all > 2. 

Claim 1. Aw = 0{\w\^^'^^^^ \n'^^^ |w|). That is, there exists a constant K (depend- 
ing only on the dimension) such that |Aw| < K\w\~'^'^'^^'> Yyl^"^ |w| for any choice of 
sequence to, . . . ,tM-i and initial state c and any w G with sufficiently high norm. 
Further, for any fixed w there is a constant hound on |Aw|, independent of the choice 
of sequence to, ... , tpf-i- 

The case when w is fixed is relatively simple and is given by Claim [Ul 

Consider the expansion (0) of Aw For each i with c + i = 0, apply © and 
replace T^{w,ti) with '^j^o—T^{w,ti). Now for each state j 7^ consider the sum 
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of all terms with When c + i = j these will be T^{w, ti) and when c + i = these 
will be —T^{w,ti). These signs will alternate, so that the sum can be written 

T^{w,ti)-T^{w,h) + ...± (w, Q (9) 

where the ti,t2, . ■ ■ form a nonincreasing sequence. (The initial sign might be negative, 
but that will not matter.) Removing copies of the same term we can assume the 
ti,t2, ■ . ■ form a decreasing sequence. (In particular, suppose the number of chips on 
a given position at a given time is divisible by 2d. Then for each state j the positive 
and negative contributions will cancel out. This is to be expected, as when the chips 
are distributed evenly the weight function will not change.) We have expressed Aw 
as the sum of a constant {2d — l) of these sequences so that to show Claim^it suffices 
to show 

Claim 2. T^(w,ti) -T^{w,t2) + ... ±T^{w,t,) = 0(|w|-("'+i) In'^"^ |w|) and is 
bounded by a constant for any fixed w. 

As a further reduction we expand 

T^(w,t) = St{w) - St-i{w - Bj) = ^ X^'S't_i(w - Gfc) - St-i{w - ej) 

k 

where k ranges over the 2d states. The sum of Claim |21 splits into 2d—l sums. (When 
k = j we get zero.) For fixed distinct states j, we set x = w — ej and z = ej — 
and, again following P, 

V.(x,t) = 5i(x + z)-5i(x) 

As |x|, |w| differ by at most one they are asymptotically the same and so Claim |21 
reduces to showing 

Claim 3. Vz(x, ti) - Vz(x, ta) + • • .±Vz(x,t,) = Odxl^^'^+i) In'^"^ |x|) and zs bounded 
by a constant for any x. 

This we shall show for any fixed z ^ and any decreasing sequence ti, . . . ,ts. 
First, we show that the contribution from small t (i.e., near the conclusion of the 
process) is small. With foresight we set 

T = ir|x|Vln2(|x|) (10) 

where i^' is a large constant to be specified. T will be our cutoff between small and 
not small. A result from ^ will be useful here: For some constant c > 0, a random 
walk beginning at the origin ends at a point at least a distance at^/^ away at time t 
with probability at most ce~". Now, |Vz(x, t) \ is certainly bounded by the probability 
that the walk ends at least a distance |x| from the origin plus the probability that it 
ends at least |x + z| from the origin, so 

|V.(x,t)|<ce-W/*^''+ce-l''+^l/*^'' 
<2ce-(W-l^l)/*'''. 



5 



Now consider the the contribution from the small t < T. We select K so that all 
I Vz(x, t)\ = 0{\x.\~'^~^). The total contribution to the sum of Claim|21from all t <T, 
there being fewer than |xp terms, is 0{\x.\~'^~^). 

We can now assume that all ti > T. We approximate the Vz(x, t) by the following 
special case of the "Local Central Limit Theorem" for simple random walks (q.v. PP): 

|Vz(x,t) - (p(t,x + z) -p(t,x))| = |x|~20(r('^+i)/2) (11) 
where | ■ | denotes the L^-norm, t x, and 

p(t,x) := 2(— )^/2g-d|x|V2t (12) 
27rt 

(Here, and throughout the rest of the proof, all hidden constants may depend on z. 
This does not affect our original problem since z takes on only a finite set of values.) 

An alternating sum of Vz(x, t) is then, in absolute value, at most the absolute 
value of the alternating sum of the approximation p{t, x + z) — p{t, x) and the sum 
of the absolute values of the errors. The sum of the absolute values of the errors for 
t > T is then 0(|x|~^T*^~'^"'"^-'/^). (Note that this argument would not work for d = 1 
as the bounds on the errors would form a divergent harmonic series.) Our choice of 
cutoff T ensures that this is 0(|x|-('^+i) In'^"^ |x|). 

Now, we wish to show that an alternating sum of the quantity f{t) = p{t,x.) — 
p(t,x + z) is 0(|x|~^'^"'"^)). We regard this as the "main term" of our calculations. 
This is the critical place where we need the alternation of the sum. That the sum 
alternates is a direct consequence of the construction of the P-machine, and represents 
in our minds the "cancelling out process" when a single rotor distributes chips in a 
(relatively) even manner. 

Claim 4. f{t) = 0(|x|-('^+^)) 

Let p = |x + z| — |w|, so IpI < |z|. Since f{t) is zero when min{|x|, |x + z|} > t, 
we may write 

f{t) < ^-a!/2|g-rf|xp/2t _ g-a!|x+z|2/2t| 

^ ^-(i/2g-d|xp/2t|-|^ _ g-dp(|x+z| + |x|)/2i| 

^^-d/2g-d|xp/2t^|^|(|x^2| + |x|)/2t 

<r^/2-i|x|e-'^w'/2*. 

It is a matter of elementary calculus to show that this function is maximized when 
t = ^j^|xp, in which case f{t) satisfies Claim |3] 

Claim 5. The sequence f{t) has at most 6 local extrema. (We say that t is a local 
extremum if f{t) > max[/(t + 2), f{t - 2)] or f{t) < min[/(t + 2), f{t - 2)]). 

Letting B = 2(rf/27r)^/^, we may write 

p{t, X) - p{t, X + Z) = 5t-'^/2(e-'i|-lV2t _ g-d(|x+zp/2i) 
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Setting the derivative equal to zero gives 



e-^y = Ki + — (13) 

y - 1 

after making the substitutions R = |xp, S* = |x + zp, y = R/t, Ki = S/R, K2 = 
{S — R)/R, and 7 = (i? — S)/2dR. This sphts into the two regions y < I and y > I. 
In each region the number of zeroes is at most one more than the number of zeroes 
of the derivative. Therefore, setting the derivative of ()13|1 equal to zero gives the 
equation 

e-^y(y _ 1)2 _ = 

The number of zeroes of this is at most (in each region) the number of zeroes of its 
derivative, which is 

e-7y[2(y-l)-7(y-l)2] = o. 

This equation clearly has at most two solutions, and the proof of ClaimElis complete. 

From Claim El the sequence f{t) can be split into a bounded (< 7) number of 
monotone sequences. On each such sequence an alternating sum is at most twice the 
maximal absolute value of the terms. Applying ClaimEJthe entire sum is 0(|x|^*^"'^^^) 
which concludes Claim 0) and thus Claim ^ in the asymptotic case when x ^ 00. 

Claim 6. For any fixed w there is a constant bound on \ A^\. 

The reductions to Claim IHl are as given. The sequence p{t, x + z) —p{t, x) clearly 
has absolute value at most two and the argument of Claim El holds for any x so an 
alternating sum of the p(t,x + z) — p(t, x) is bounded. The error terms, from ()11|) . 
are 0{t~^^'^^^^'^) and so their sum is bounded for all d > 2. 

Having shown Claim Q we may now show Theorem ^ Equation (I7|) and this 
Claim gives 

Xr,-Xo = 0{J2 |wr('^+^) In'^-^ |w|) = 0(1). (14) 

□ 

2 Conjectures 

In the course of proving the main theorem, we encountered the following intriguing 
conjecture. 

Conjecture 1. For each ^ : Z"^ — > R with finite support, and for all v G Z'^, the 
function W2n(v,0 o,t most K sign changes in the variable n, where K depends 
on ^ and d but not on v. 

To see where this statement comes from, note that, for any ^, we may always 
use the harmonic property to write W^2n+2(v,0 ~ M^2n(v,^) = W2n(y,0 for some 
^ : %^ ^ M. Then, W2„(v,^) has a bounded number of local extrema if and only 
if W^2n(v,.^') has a bounded number of sign changes. Therefore, if this conjecture 
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were true, we could simply estimate the alternating sums in the proof by a constant 
times their largest term, and the burden of bounding the error terms in (lllj) would be 
reduced somewhat. Our intuition is that this statement is true because "oscillations" 
in p{n, v) occur only to the modulus 2. 

Furthermore, we believe that the polylogarithmic factor in the bound on |Aw| is 
unnecessary. Indeed, this would follow from Conjecture H 

Conjecture 2. For any d, |Aw| = 0(|w|^'^'^+^)). 

For very simple C,, such as one whose support consists of a single vertex, we 
actually expect unimodality. That is. 

Conjecture 3. The probability that a random walk beginning at the origin in Z'^ 
arrives at v at time n ^ \ is a unimodal function of n. 

The estimates given above are inadequate to prove this simple statement. Fur- 
thermore, attempting to show unimodality via log-concavity is futile, since these 
functions are often (perhaps always?) log-convex in the tail. In the d = 1 case, we 
can show unimodality by brute force. Indeed, p{n,x) = '^~"'{(^n+x)/2) ^'^^ 3; > 0, and 
the ratio of consecutive terms is given by 

p{n, x) n{n — 1) 
p{n — 2, x) n? — x'^ 

so the sequence is for n < x, increasing up to = a;^, and decreasing thereafter. A 
similar argument also works for d = 2. It is clear that it suffices to prove unimodality 
for the half-quadrant where x > and y < x. Note that, in a random walk on Z^, the 
quantities x + y and x — y vary independently at each step. Furthermore, x + y and 
X — y follow one-dimensional simple random walks. Therefore, we may decompose 
the two-dimensional walk as follows: 

p{n, (x, y)) = p{n, x + y) ■ p{n, x - y) 

V(n + X + y)/2) \{n + x- y)/2) 

If we consider the ratio of successive terms, 

p{n,{x,y)) n^{n — iy 

p{n — 2, (x, y)) {n + X + y){n + X — y){n — X + y){n — X — y) 

In the range n > x + y, this quantity is < 1 precisely when g[n) = 2n^ — rn^ + s is 
positive, where r = 2x^ + 2y'^ + 1 and s = (x^ — y^)^. When n = x + y, 

g{x + y) = -(x + y)\x + y-lf<0. 

On the other hand, g' has two roots: one at n = and one at n = r/3. Since 
< X + y, at most one root of g occurs at in [x + y, +oo), so we may conclude that 
p{n, (x, ?/)) is unimodal in n. 

Unfortunately, this kind of analysis does not seem to be possible in higher dimen- 
sions, so further insights are necessary to resolve the conjecture when d>3. 
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